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ABSTRACT 



The urgent need for an effective performance-based 
assessment tool that can make the connection between effective teaching and 
student learning has spurred action by expert educators. The Teacher Work 
Sample Methodology (TWSM) is a quality assurance system that can assess what 
students learn, how well they learn it, progress they make in their 
individual learning, and how students who are not making progress can be 
helped. The TWSM can link teacher effectiveness and teacher preparation to 
student learning. Oklahoma educational leaders are in the process of using 
the Oklahoma TWS (OKTWS) as one of its three Oklahoma Teacher Enhancement 
Program (OTEP) assessment components to be used with first year teachers to 
make a close connection between teacher preparation and the impact the 
beginning teacher has on student achievement in the classroom. The OKTWS 
offers a teacher-made, multi-week teaching unit. The TWS was chosen by the 
Title II OTEP because it is the most authentic assessment currently available 
to measure teacher ability to impact student classroom learning, not only 
according to NCATE standards, but also to Oklahoma's 15 teaching 
competencies. The OKTWS prompt consists of: the prompt (which provides 
instructions and explanation on completing the six OKTWS factors) and the 
rubric, which includes a checklist section and various demonstration 
components. (SM) 
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The TWSM: An Essential Component in the Assessment of Teacher Performance 

and Student Learning 

Ever since A Nation at Risk was published, demands for quality teachers have 
ensued. Educators, legislators, teacher organizations, school boards, and business leaders 
have embarked on national meetings regarding how to train quality teachers, what is a 
quality teacher, and how do we assess quality teaching. National standards and/or 
assessments have been outlined by the National Board for Professional Teaching 
Standards (NBPTS), the National Commission on Teaching and America’s Future 
(NCTAF), the National Council for Accreditation of Teacher Education (NCATE), and 
the Interstate New Teacher Assessment and Support Consortium (EMTASC). 

NCTAF (1996) stated “teachers must go beyond dispensing information, giving a 
test, and assigning a grade” (p. 8). Teachers must be very knowledgeable about their 
subject area, understand students to create meaningful learning experiences, and meet the 
diverse needs of the individual students in the classroom. Understanding this concept, 
NBPTS has set standards and created assessments in order to determine teacher quality 
on a national level. NBPTS has been the most successful and influential organization to 
implement teaching standards that mark teacher quality, but NBPTS does not measure 
student achievement and its relationship to teacher effectiveness. Therefore, we must 
realize that “the development of standards alone cannot ensure the success of school 
reform” (Holbein, 1998, p. 560). To try and improve student achievement in the 
classroom, “pressure has mounted from state and federal lawmakers in recent years to 
hold higher education teacher training programs accountable for the quality of their 
graduates” (Dilworth, 2000). President Bush’s plan, “No Child Left Behind,” calls for 
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performance based assessment, subject area and professional education exams, and no 
out-of-field teaching assignments. The belief is that quality classroom teachers will result 
in student achievement. The first step by the United States Department of Education to 
hold higher education accountable has resulted in the Title II Report Card requiring each 
state to report the pass rates on teacher assessments for all program completers from a 
state higher education institution teacher education program and a comparison between 
their institutions statewide. 

The call for accountability does not stop with the Title II Report Card. NCATE 
has set rigorous standards “and expect colleges to demonstrate that teacher candidates are 
gaining the knowledge, skills, and dispositions necessary to have a positive impact on P- 
12 student learning” (Mitchell, 2001, p. 4). Based upon this evidence, teacher education 
programs will be held accountable for the quality of their graduates. These graduates will 
have worked through a performance based education program, subject area testing, and a 
portfolio that represents their competence and skill as a reflective, learning, beginning 
educator, as outlined by their higher education institution’s teacher preparation program. 
However, this assessment process does not measure student achievement while the 
student teacher is in the classroom, and by 2003, NCATE accredited programs must 
provide evidence that their education graduates, who are in their first year of teaching, are 
impacting student learning in their own classrooms. Many education organizations have 
produced standards and/or assessments to measure excellence in teaching, and 
performance examinations to be used in participating INTASC states are in development; 
however, an assessment tool that adequately measures these standards for teacher 
preparation and links them to student achievement does not exist. The need for a 
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performance based assessment tool that can be used to not only measure teacher quality, 
but also to link student achievement to teacher quality is immediate if higher education 
institutions and public school systems are to adhere to the demands of their own 
credentialing organizations and to the federal government. 

The urgency and need for an effective performance based assessment tool that can 
make the connection between effective teaching and student learning is understood and 
has spurred action by expert educators. Schalock, Schalock, and Myton (1999) presented 
the Teacher Work Sample Methodology (TWSM) as a quality assurance system that can 
assess “what students learn, how well they are to learn it, the progress each student is 
making in his or her learning , and how each student who is not making the progress can 
be helped to do so” (p. 1.9). It is being used by Oregon as a “continued requirement... for 
initial licensure of teachers... and [a] recent addition as a requirement for continuing 
licensure” in the 1999 redesign of education standards in Oregon (Schalock, Schalock, & 
Myton, 1999, p. 1 .6). The promise the TWSM makes in linking not only teacher 
effectiveness but also teacher preparation to student learning has launched more 
educational institutions to develop a teacher work sample that will meet their program 
needs. 

A Title II Grant Consortium, the Renaissance Partnership for Improving Teacher 
Quality directed by Roger Pankratz, is piloting the Teacher Work Sample Methodology 
(TWSM) with student teachers from ten different higher education teacher programs in 
nine different states in an effort to document the relational evidence of teacher 
performance and student learning. Emporia State University’s teacher preparation 
program, initiated by Dr. Jerry Long and Dr. William Samuelson, is a part of the 
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Renaissance group but has adapted the Teacher Work Sample (TWS) to meet the needs 
of its teacher preparation program in the state of Kansas. Oklahoma’s educational leaders 
have studied the work of the Renaissance and Emporia State University and are in the 
process of using the Oklahoma TWS (OKTWS) as one of the three OTEP assessment 
components (the other two being the portfolio and teacher observations) to be used with 
first year teachers in order to make as close a connection as possible between teacher 
preparation and the impact the teaching program graduate has on student achievement in 
his/her own classroom. 

Is the TWS the assessment tool that can link teacher preparation and performance to 
student learning? Schalock believes “teacher work samples of the kind now being 
used... provide at least a start toward obtaining evidence on the effectiveness of 
teachers... and a quality assurance system that holds student learning as its core” (2000, p. 
1.6). Pankratz states “the work sample methodology provides direct evidence of a teacher 
candidate’s effect on student learning in a relatively short time period and clearly 
connects the elements of standards-based teaching and learning” (in paper presented at 
2000 AACTE Conference, p. 37). The TWS has been chosen by the Title II Oklahoma 
Teacher Enhancement Program (OTEP) because it is the most authentic assessment 
currently available to measure the teacher’s ability to impact student learning in the 
classroom not only according to the NCATE standards, but also to Oklahoma’s fifteen 
teaching competencies. 
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The OKTWS prompt is composed of two sections: the prompt and rubric. 

The prompt provides instructions and explanation on completing the six Factors of the 
OKTWS: Contextual Information, Unit Learning Goals, Assessment Plan, Instructional 
Design, Analysis of Learning, and Reflections on Teaching and Learning. The 
information and reflection required by the OKTWS Factors are responsive of 
Oklahoma’s fifteen teaching competencies as well as the NCATE standards and requires 
teachers to utilize the Oklahoma’s Priority Academic Student Skills goals and objectives 
in their work sample. 

The OKTWS is composed of a teacher-made, multi-week teaching unit. The teacher 
works through the procedural steps for conceptualizing and implementing a teaching unit 
based upon students’ learning needs and established standards, gives a pre and post 
assessment from which learning gains for all students are analyzed. The teacher 
summarizes, interprets, and reflects on each step of the teaching process and analyzes 
student growth in comparison to where students were when the unit began and where 
they are at the end of the teaching unit. 

The second part of the work sample is the rubric. The rubric has two parts: a checklist 
section to designate what should be included in each Factor and a varied number of 
demonstration components. The demonstration components are evaluated on three 
performance levels: Standard Not Met, Standard Partially Met, and Standard Met. These 
performance levels relate in detail what teachers should be demonstrating within that 
Factor. Teachers demonstrate their level of performance through the information and the 
reflections they are asked to provide. 
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For example, in the Contextual Information Factor 1, a checklist shows teachers that 
within their reflections of this section, they should include the number of students they 
have, their ethnic, cultural, and gender make-up, socio-economic status, classroom 
environment, community environment, students with special needs, and the 
developmental characteristics of students. This information is then used in the teacher’s 
discussion of her students’ learning needs, modifications needed, instructional decisions, 
and other learning considerations. The contextual environment provided by the teacher is 
taken into consideration when scoring the work sample. 

The teacher works through the teacher work sample as she works through the 
teaching unit. Goals for the unit are established and explained in Factor 2: Unit Learning 
Goals. The formative and summative assessments are designed and related to the unit in 
Factor 3: Assessment Plan. Factor 4: Instructional Design involves the development and 
implementation of the Unit. Factor Five: Analysis of Learning focuses upon the 
presentation of the pre and post-test scores of students and the teacher’s discussion of 
their learning gains. Although a display of positive learning gains by the students is the 
goal of the teacher, it sometimes does not happen. Therefore, the importance of this 
component lies in the teacher’s analysis of the scores and the relationship they have to 
instructional methods used and the classroom context. If students do poorly on a 
particular question, the teacher addresses this issue. We know many reasons could exist 
for this scenario, but how does the teacher explain it using the classroom’s contextual 
information and his or her own knowledge of teaching? Where and when do 
modifications need to be made? 
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These are the questions teachers need to ask as they teach, and these are the questions 
teachers need to be able to answer. If by using the work sample these teachers can make a 
direct connection to what they know about pedagogy and the teaching skills they learned 
in teacher preparation and how to implement this information to benefit the learning of 
their students, then the link between teacher preparation and student learning has been 
made. 



Resources 

Dilworth, M. (2000, May). Chronicle of Higher Education. 

Holbein, M.F. (1998, Summer). Will standards improve student achievement? 
Education. 188 (4), 559-564. 

Mitchell, A. (2001, Fall). Learnings from the NCATE pilot institutions. NCATE: The 
Standard of Excellence in Teacher Preparation. 10 (1), 4-5. 

National Commission on Teaching & America’s Future. (1996, September). 

What matters most: Teaching for America’s future. New York: Teachers College. 

Pankratz, R. (2000, February). Becoming accountable for the impact of graduates on 
students and schools: Making operational the shift from teaching to learning . Paper 
presented at the 2000 AACTE conference, Chicago. 

Tracy Fredman, Ed.D., is the Title II Oklahoma Teacher Enhancement Program grant 
coordinator. 

The views presented in this paper are those of the author and do not necessarily 
represent those of the Oklahoma State Regents of Higher Education. 




9 



U.S. Department of Education 

Office of Educational Research and Improvement (OERI) 
National Library of Education (NLE) 

Educational Resources Information Center (ERIC) 

REPRODUCTION RELEASE 

(Specific Document) 



I. DOCUMENT IDENTIFICATION: 



Title:' f :/;aJ 

“uothnv o^c) S-- 


(frmpo>w\f ia 
r udtvJ’ Ljarp i 


4Ajl of 


Author(s): (r Pi r (. LA 


1.1 


i. 


Corporate Source. OK/& . j^fOv|| 


rJs' JJjg|mv 

hJmm 


/ 

nM 


Publication Date: 



II. REPRODUCTION RELEASE: 



In order to disseminate as widely as possible timely and significant materials of interest to the educational community, documents announced in the 
monthly abstract journal of the ERIC system, Resources in Education (RIE), are usually made available to users in microfiche, reproduced paper copy, 
and electronic media, and sold through the ERIC Document Reproduction Service (EDRS). Credit is given to the source of each document, and, if 
reproduction release is granted, one of the following notices is affixed to the document: 





If permission is granted to reproduce and disseminate the identified document, please CHECK ONE of the following three options and sign at the bottom 
of the page. 



The sample sticker shown below will be 
affixed to all Level 1 documents 


The sample sticker shown below will be 
affixed to all Level 2A documents 


The sample sticker shown below will be 
affixed to all Level 2B documents 


PERMISSION TO REPRODUCE AND 
DISSEMINATE THIS MATERIAL HAS 
BEEN GRANTED BY 




PERMISSION TO REPRODUCE AND 
DISSEMINATE THIS MATERIAL IN 
MICROFICHE, AND IN ELECTRONIC MEDIA 
FOR ERIC COLLECTION SUBSCRIBERS ONLY, 
HAS BEEN GRANTED BY 




PERMISSION TO REPRODUCE AND 
DISSEMINATE THIS MATERIAL IN 
MICROFICHE ONLY HAS BEEN GRANTED BY 


A® 




.<* 










.A'' 

c? 




c/ 


TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC) 




TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER {ERIC) 




TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC) 


1 




2A 




2B 



Leve l 1 Level 2A Level 2B 

I t t 



X. 



Check here for Level 2A release, permitting Check here for Level 2B release, permittirtg 

reproduction and dissemination in microfiche and in reproduction and dissemination in microfiche only 

electronic media for ERIC archival collection 
subscribers only 

Documents will be processed as indicated provided reproduction quality permits. 

If permission to reproduce is granted, but no box is checked, documents will be processed at Level 1. 



Check here for Level 1 release, permitting 
reproduction and dissemination in microfiche or other 
ERIC archival media (e.g. t electronic) and paper 



Sign 
here,-* 
please 



O 

ERiC 



/ hereby grant to the Educational Resources Information Center (ERIC) nonexclusive permission to reproduce and disseminate this document 
as indicated above. Reproduction from the ERIC microfiche or electronic media by persons other than ERIC employees and its system 
contractors requires permission from the copyright holder. Exception is made for non-profit reproduction by libraries and other service agencies 
to satisfy information needs of educators in response to discrete inquiries. 

I X 






/ A A 



•AO, 



Org^ixatip 

ML 



xv JzA 
OX 



75/0/- 






.1 znLXL 

1§5 



Printed Nan^o S iliO(^tle:Of<'|^U^yv^(xiver' 



nr*e/Posi|ii 

Em 



ft 



f(3QY(WV\CKOYr\iMt rt 






FAX:, 






(over) 




III. DOCUMENT AVAILABILITY INFORMATION (FROM NON-ERIC SOURCE): 

If permission to reproduce is not granted to ERIC, or, if you wish ERIC to cite the availability of the document from another source, please 
provide the following information regarding the availability of the document. (ERIC will not announce a document unless it is publicly 
available, and a dependable source can be specified. Contributors should also be aware that ERIC selection criteria are significantly more 
stringent for documents that cannot be made available through EDRS.) 




IV. REFERRAL OF ERIC TO COPYRIGHT/REPRODUCTION RIGHTS HOLDER: 

If the right to grant this reproduction release is held by someone other than the addressee, please provide the appropriate name and 
address: 




V. WHERE TO SEND THIS FORM: 



Send this form to the following ERIC Clearinghouse: 

ERIC Clearinghouse on Teaching 
and Teacher Education 
1307 New York Ave. , NW 
Suite 300 . 

Washington, DC 20005-4701 



However, if solicited by the ERIC Facility, or if making an unsolicited contribution to ERIC, return this form (and the document being 
contributed) to: 



ERIC Processing and Reference Facility 
4483-A Forbes Boulevard 
Lanham, Maryland 20706 

Telephone: 301-552-4200 
Toll Free: 800-799-3742 
FAX: 301-552-4700 
e-mail: ericfac@ineted.gov 
WWW: http://ericfac.piccard.csc.com 

EFF-088 (Rev. 2/2000) 

0 




